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(57) ABSTRACT 

Integrated imaging and GPS network monitors remote 
object movement. Browser interface displays objects and 
detectors. Database stores object position movement. Cam- 
eras detect objects and generate image signal. Internet i 
provides selectable connection between system controller 
and various cameras according to object positions. 
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INTEGRATED NETWORK FOR system or apparatus for performing real-time, historical 

MONITORING REMOTE OBJECTS and/or predictive monitoring and data processing of one or 

more remote or local objects 2. As used herein, the term 
X "object", is construed broadly to include any singular or 



FIELD OF THE INVENTION A multiple, wired or wireless, chattel, person, animal, or^ 

The invention relates to remote surveUlance and commu- ^HOEHS-^Fiirthermore, term "signal" is also construed^ 
nications technology, particularly to integrated fixed and 



mobile network electronics and related software for object 
attribute processing. 

BACKGROUND OF THE INVENTION 

Remote or local object monitoring schemes have been 
used for various specific surveillance applications, such as 
closed-circuit security video systems, as well as wireless 



broadly to include any electro nicdigital "and/or analog pulses 
or other recognizable or coded waveform, as well as any^ 
digital bit stream or other processor-recognizable valued' 
variable or data form." 

For example, object may represent one or more member 
belonging to common or assigned family, classification, or 
other actual or virtual grouping or enterprise. It is further 
contemplated that objects 2 could include any moveable 



mobile navigaUon systems using relaUvely near reference or (" S- pedestrian vehicular etc.) EhisSSLilSm, such as 



distant satellite signals (e.g., Global Positioning Satellite 
system (GPS)). Prior techniques and systems for remotely 
monitoring typically provide positional or visual informa- 
tion of interest about certain object context, e.g., bank 
facility surveillance (see: U.S. Pat. Nos. 4,524,384, 4^11, 
886), or trucking vehicle movement (see: U.S. Pat. Nos. 
5,673,305, 5,223,844); however, such prior art schemes are 
necessarily limited to addressing either fixed or mobile 
context specifically for which the particular monitoring 
system has been designed originally. 

Hence, there is need for more flexible and scaleable 
solution for monitoring and processing remote objects 
according to various more general context and related object 
conditions. 30 

SUMMARY OF THE INVENTION 

The invention resides in an integrated fixed and/or wire- 
less network and associated database and software function- 
ahty for monitoring and processing remote and/or local 35 
moveable objects. Preferably, the system implementation 
integrates singlechip digital imaging camera and Global 
Positioning Satellite system (GPS) receivers through gener- 
ally accessible server processors using the Internet network 
and a software browser or functionally equivalent interface 40 
coupled thereto for monitoring and analyzing remote or 
local movement of one or more objects. 

An object database or functionally equivalent data struc- 
ture provided in digital storage and accessible to control 



person, animal, vehicle, mobile fleet, containers, belongings, 
or other non-fixed chattel which mav cbaqge Incatinp x^ ]^. 
U vc to one or more fixed locations, such as general transit 
paths or other typically non-moving sites (e.g., hallways, 
roads, railway, etc.), homes, offices, schools, hotel, 
hospitals, warehouses, stores, etc.). 

Preferred integrated network monitoring system includes 
one or more central console controller or user processor 6 
coupled to digital switch or other selectively accessible, 
packet ana/or circuit-switctied network communications 
mtrastructure ^. JN etwork » mav be functional aggregate of 
multiple sub-networks including conventional or proprietary 
networking equipment for enabling access to and/or through 
the World Wide Web (WWW),^or other functionally equiva- 
lent local and/or wide area network (LANAVAN) intercon- 
nectivity. 

Network 8 provides digital connection to or from any 
allocated web node address or equivalently accessible net- 
work resource, such as Uniform Resource Locator (URL), 
associated hypertext files, and other proper domain name 
and file location, according to Transmission Control 
Protocol/internet Protocol (TCP/IP) addressing scheme and 
proper hypertext file transfer protocol (HTTP). In this way, 
networking is achieved via one or more network ports or 
other functionally equivalent servers and/or other conven- 
tional wired or wireless network access equipment (e.g., 
router, modem, hub, bridge, etc.) configured conventionally 
for transferring and/or transmitting data to/from and/or 
through the Internet,* Such World Wide Web and Internet 



software dynamically stores one or more positional and ^5 protocol and associated networking and remote access stan 



relative movement as well as optional associated map data. 
Various digital cameras preferably disposed at certain fixed 
and/or movable locations detect mobile objects and generate 
object image signal for processing thereof as described 
herein for particular applications. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a general block diagram of an integrated fixed 
and mobile system for monitoring and analyzing remote or 
local object(s) according to the present invention. 

FIG. 2 is a more detailed block diagram of target unit 4 of 
FIG. 1 provided according to the present invention. 

FIG. 3 is a more detailed block diagram of controller 6 of 
FIG. 1 provided according to the present invention. 

FIG 4 is a block diagram of the general methodology of 
the integrated system for monitoring remote objects accord- 
ing to the present invention. 

DETAILED DESCRIPllON 

FIG. 1 illustrates a general block diagram of preferred 
embodiment of integrated fixed and/or mobile network 



dards as are specified in published hard-copy or on-line 
documents are hereby incorporated by reference. 
As used herein, term "proprietary" pertains to known 
5Q privately-implemented digital networking techniques, 
equipment, or related electronics and software, however, 
configured at least in part according to non-standard marmcr 
and may still be standard compliant. 
Controller 6 preferably is implemented for user monitor- 
55 ing ol one or more objects 2 usixig conventional computer, 
>yorkstatioii^ or functionally equivalent digital processing 
equipment and/or software. Contemplated examples of con- 
troller 6 functionality may include following, if configured 
to operate as specified herein; Network Computer-type 
60 product from Oracle, WebTV-type product from Microsoft, 
Pilot-type product from Cisco or substantially compatible 
network processor products thereto. Publicly accessible 
product functionality and interface specifications, including 
hard-copy or on-line published documents therefor, for such 
65 products are hereby incorporated by reference. 

Controller 6 may include^one or more standard digital 
microprocessor unit, operating system software (e.g., 
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I Windows, NT, CE, etc.), riipr iia^ stnrapp HpviVp ^ (e.g., disk, comparison, term "mobile" is understood to mean movable 

^\TrrMr^ , memory, cache, etc.), o utput/input devices (e.g.. keyboard, or moving relative to such fixed sites. 

* ^ f&jj\cfi^^^^^^^^' microphone, speaker, camera, etc.). Following are sample location categories or site classes: 

\i\p^ CW^ Fiirthermnre. cnntrnller 6 mav include c onventional network common public or private areas including carrier transit 

A VtO Ic accessing interface firniwarc or circuit, such as Ethernet s (transport stations, bus, train, plane, ship, taxi, emergency/ 

card, and remote processing or network access software such transport vehicles, etc.), asset storage (warehouse, library, 

^^j^Ji, as web browser (e.g., Netscape Navigator, Microsoft etc.), transport paths (roads, hallways, rivers, sidewalks, 

Explorer, etc.), preferably using conventional or proprietary etc.), general human transaction sites (stores, schools, 

text, graphics, and other media format, such as Hyper Jext homes, hotel, hospitals, sports locations, mobile homes, 

Markup Language (HTML), Extensible Markup Language parks, etc.). 

(XML), JAVA, or streamed video or audio data forma t. VoP Integrated network growth is planned according to actual 

this configuration, real-time or stored remote and/or local or anticipated network communication traffic corresponding 
access is achieved via the Internet or functionally equivalent^ to particular coupled detector-server sites, sets or geographi- 

enterprise or intranet network of object data to or from one cal clusters thereof, such that locations associated with 

or more target units 4, for example, in accordance with the higher density of objects and/or movement thereof are 

present invention. installed with additional monitoring detector/server facih- 

As shown, network 8 further couples to one or more ties. Accordingly, integrated system database maintains and 

conventional Internet, intranet or other LANAVAN network updates past, current and planned locaUon for each sensor 

connecUon or server 5 and sensor or detector 3, as well as coupled to such system, preferably as function of lime or 

communicator 7 for communicating, preferably through schedule. Additionally, when existing detector and/or server 

conventional or proprietary wireless connection, to one or site is relocated, corresponding database entries 162 arc 

more target unit 4. Note that server 5 may be any electronic updated. 

hardware, firmware or software suflficient to couple detector Detectors 3 may be single or multi-chip charged coupled 

3 electrically and accessibly to network 8, and that detector device (CCD) and /or complementary metal oxide seraicon- 

3 may provide substantially equivalent input functionality of ^ ductor (CMOS) digital imager or video capture devices, or 

sensor 44 of target unit 4. Preferably, electronic interface other functionally equivalent monitoring apparatus for opti- 

coupling between server 5 and network 8 provides for cally (e.g., black & white, color, infra-red, etc.) sensing and 

dynamic "hot-swap" interoperability, such that minimal transmitting static and/or moving image signals. Preferably, 

network re-configuration and associated delay is required. detector 3 includes display indicator, such as light-emitting 

For example, server 5 may be provided as simplified 30 diode (LED), which indicates obviously to any nearby 

electronic network device having convenUonal processor, monitored person when such detector 3 is actively in moni- 

embedded controller, or digital signal processor with real-. toring mode, or other conventional display for indicating 

time kernel or operating system, storage. Ethernet and/or identity of monitoring party name, console source or loca- 

modem facility, as well as electrical connectivity to detector lion- 

3 or other appliance, such as through Universal Serial Bus 35 Furthermore, such detectors 3 may be implemented in 
(USB), X-10, 1EEE1394 (FireWire), or other conventional non-imaging physical sensor manner, such as magnetic or 
electrical signaling standard interface, which published smart card or reader, tactile finger-print sensor-type device, 
specifications are hereby incorporated by reference. Hence, medical analog and/or digital instrumentation for measuring 
server 5 preferably includes uniquely identifiable IP address patient vitals and related records (e.g., pacemaker operation, 
or subset packet addressing scheme associated therewith; 49 temperature, blood pressure, mental activity, 
and preferably more than one detector may be uniquely electrocardiogram, medication level, and other similarly 
accessible, in parallel or multiplexed, by single server. monitorable information and signals). 
In this combined or integrated fixed and mobile network Alternately in facility monitoring application, detectors 3 
i, / arrangement, controller 6, which in combination with net- may be implemented to sense state and other measurement 
njfhJtt^MM' ^ work 8, communicator 7, as well as servers 5 and corre- 45 signals from motion detector, burglar alarm, door or window 
^Irjij^^ detectors 3 coupled thereto are located in relative open/close detector, smoke detector, thermostat, phone 
^^^^L^yie/C^ fixed locations, and communicates with or effectively moni-"^ answering machine, or other electrical home appliance. In 
Sf«A,v ^^^^ through network 8. Preferably such arrangement uses'^ certain instances, e.g., unauthorized home entry, such sensed 
L conventional TCP/IP protocol Internet website addressing state may trigger other fimctionality, such as taking elec- 
1^ scheme, one or more fixed or movable object 2. This is 50 tronic photograph and/or notifying certain entities. In this 
(UpfVLA*- • ^-^W^O^^^ p erformed by accessing real-time object data or other con- home application, such appliance may couple electrically to 
t extual inform ation available or accessible via public or network 8 via server 5 or other functionally equivalent 
^TTLP/i P private IP address or other website associated with o r interface, for example, using standard electrical signaling 
. M su pported bv one or more detector 3-server 5 coupled paTr^ interface such as USB, IEEE1394 (FireWire), or so-called 
ryfb'TCC-O Detector-server coupling sites are disposed within detecting, ss X-10 interface for communicating through standard electri- 
» . r\ viewing, or other physically proximate range relative to one cal lines coupled thereto. 
V\P \ I or more specified object or set of objects 2. Optionally, detectors 3 may be coupled to control mecha- 
Q^li^^JyJ^J^^>^^^^ In accordance with an important aspect of present nism for adjusting detector operation, such as focus, tilt, pan, 
invention, integrated network connectivity is planned such focus, etc., as well as means for causing multiple neighbor- 
that one or more detectors or sensors 3 arc installed at 60 ing detectors to observe and track common objector object 
preferably fixed, although possibly slightly movable, physi- set, thereby obtaining various comparative surveillance data, 
cal sites or locations in deliberate and distributed fashion. As Further optionally, un<ouplcd or non-functional but obvi- 
used herein, term "fixed" is tmderstood to mean un-movably ous "decoy*' detector/server sites may be installed at select 
mounted, at certain physical location or limited area, locations to provide deterrent observation effect as well 
although still relocatable to other fixed sites, and still adjust- 65 reduce network traffic and overall cost. However, hidden 
able or redirectable while at such fixed site, for example, to detector/server site may be provided to observe object 
point at different direction or angular displacement. In activity proximate to decoy site. 
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In accordance with an important aspect of present 

invention, deteytnrs 3 are accessible thrniigh Internet^ 
intranet,:) o r other functionally equivalent networking con- 
necuon. in this way, currently detected object data signal 
may be obtained therefrom. Any one or more user with 
proper access capability (e.g., computer with browser, Inter- 
net access, and proper authorizations) may observe or down- 
load such object data information, eitlier in multi-cast mode 
(i.e., multiple observing controller users belonging to group, 
neighborhood or other common interest monitoring same 
detector or object or set thereof,) or point-to-point mode 
(i.e., single observing controller user monitoring one or 
more detector or object or set thereof). Data download may 
be delivered in JAVA applet format, preferably including 
search-able embedded pixel image or digital watermark, or 
otherwise authorized only to run on specified sites or pro- 
cessors. Preferably, each detector 3 couples continuously to 
provide digital data stream to Internet 8 generally through 
corresponding server 5 having identifiabl e IP address , packet 
identifier, or other network link to file or directory contain- 
ing desired monitored object data. 

Moreover, acx;essed object data or other contextual infor- 
mation may be obtained by one or more monitoring user 
controller 6 through network 8 and one or more conven- 
tional or proprietary wired or wireless communicator 7 ^5 
coupled thereto fnr cnmmnnicatinfr with one or more target 
units 4 as well, preferably via pubUc or private IP address or 
other website associated with or supported by one or more 
target unit 4 located physically with or proximately observ - 
able or detectable to one or more monitored object 2^ In such 
distributed client-server configuration including communi- 
cator 7 and one or more target unit 4, it is optionally 
contemplated that functionality and operation of controller 6 
and one or more target unit 4 may be functionally equivalent 
or redundant. 35 

In accordance with an important aspect of present 
invention, one or more mobile target units 4 are provided to 
move with and observe an associated object 2. Target units 
4 preferably are wireless communications devices which 
function also determine current object location and 40 
movement, as well as sensed or detected condition, image, 
sound, etc. Accordingly, target units 4 may couple wirelessly 
to at least one controller 6 through network 8, as wireless 
communication service 7 provides conventional or propri- 
etary connectivity between the Internet and target units 4. 45 

Hence, in this combined innovative architecture and 
methodology, the overall integrated system preferably 
includes a geographically or relatively fixed network of 
multiple detectors each uniquelv accessible through Internet 
browsing interface , overlaid with a mobile set of target units 50 
4 closely associated or attached to certain objects 2 for 
remote monitoring thereof. More accurate object monitoring^ 
is achieved by using piultinlc fixed detcctny^ ^ especially in 
conjunction with mobile object detection, motio n 
surveillance, processing, analysis, diagnosis and/or updat e 55 
reporting sottware provided therewith. Additionally, sub- 
stantially improved and low-cost surveillance scaleability 
and accessibility is achieved by leveraging the Internet 
and/or various comparable networking infrastructure to pro- 
vide wirfed and/or wireless connectivity. 

Further, as described herein, control software 66, prefer- 
ably including one or more modules described hereunder 
and provided in whole or in part in storage 49 for execution 
by processor 48 in target unit 4 and/or controller 6, to enable 
communications 161 between such fixed and mobile 
components, maintain object data status and mapping infor- 
mation 162, track and correlate movement activity from 



60 



different sources 163, maintain system security and access 
164, manage object-related electronic transactions 165, 
diagnosis and analyze object performance, provide data 
reporting, and analyze visual object information 168. 

Target units 4, shown in FIG. 4 block diagram, arc 
disposed for relative object 2 communications, tracking and 
monitoring at various fixed or movable locations in selected 
topology or geography preferably in anticipated or known 
paths of object 2 movement relative to fixed location of 
controller 6, network 8, communicator, server 5, or detector 
3. Target unit 4 may include sensor unit 44, communicator 
unit 46, and locator unit 42, as well as portable power source 
(not shown) preferably including low-power indicator. 
Preferably, target unit 4 uses non-volatile memory such that 
digital stored data is not erased during power outage. 

Sensor unit 44 may include one or more video cameras, 
active sensor, infra-red detector, microphone, or other 
optical, medical, or otherwise physical monitoring or obser- 
vation device to provide real-time object data, such as audio 
and/or video signals, or other electronically delectable fre- 
quency signal, such as infra-red, or other analog or digital 
electrical signal sensed from monitored object 2 depending 
on nature of object and kind of monitoring desired. 
Preferably, target unit 4 input sensor 44 processes authen- 
ticated voice pattern for proper recognition and/or dialing of 
user instructions or other language syntax, but one or more 
microphone audio functionahty may be user-selectively 
de-activated for privacy or activated continuously for detec- 
tion and recording. 

Communicator unit 46 is coupled to sensor unit 44 to send 
and/or receive real-time or store-and-forwarded object data 
or packets preferably generated by sensor 44. Processor 48 
and memory 49, including preferably operating system and 
web browser software, are also provided optionally to 
enable access and/or processing of data, such as real-time 
object data associated with predetermined website, IP 
address, or so-called Internet website hot-link or URL, as 
received from sensor 44 and accessible via any correspond- 
ing server equipment coupled thereto. 

In such self-contained processing configuration, control- 
ler 6 may conduct real-time viewing n r analysis of object 
data. Processor 48 is programmable to monitor one or mor e' 
" pre^oxtEgured website, i.e., corresponding to IP address fo r 
particular object 2 observable or prnTimate at ccrtum eve^ 
or ume wmdow, tor site hits thereto, or user modification 
requ ests to change object observation or processing as 
desnea to provide remote object access and modification 
thereof . 

In one embodiment, processor 48 monitors observed input 
to sensor 44 for new object data and provides such data to 
pre-configured webpage site. Controller 6 accesses and 
views such object data at corresponding site address or URL 
via Internet browser tool. User instructions and/or modifi- 
cations thereto can be conveyed to target unit 4, for example, 
to change, select, or adjust particular sensors 44, such as 
camera focus, zoom, tilt, angle, pan, etc., or other such 
operational attribute of sensor device 44 of target unit 4. 

Additionally, controller user may provide input to specify ^ 
or request current or future monitoring or surveillance of one^ 
or more certain location (i.e., associated fixed detector site) 
or object (i.6,, associated mobile target unit site). In this 
maimer, software 66 is configured or updated via databasg 
records, object movement and observation rules, ob j ect , ' 
t arget unit or controller commumcauons merewim, as well- 
as any related transaction, diagnosis, reportmg and security 
considerations appropriate to include, for recognizing or- 
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searching one or more object, or contextual observations a^ Preferably target unit 4 is physicaDy compact and/or 

detector sites or object directories associated therewilK*. rugged portable device, appropriate for hand-held use or 

Variety of remote object surveillance applications are mounting on instrumentation or in vehicle or automobile 

contemplated, such with multiple sensors 44 using video dashboard, and includes text multi-media, and/or graphic 

cameras situated at regular intervals or high-traffic locations s display output and associated drivers 43. Internet browser 

at remote sites to observe multiple or moving objects. software may be provided therein to aUow user remote 

In case of health care applications, such as remote medical communication and data access to other applications and 

patiem monitoring, sensor 44 may include one or more databases via the Internet. Input functionality is provided for 

medical instrumentation for observing or attachable to sensor 44, including possibly keypad, touch-screen, electri- 

paUent. Target tracking unit 4 preferably includes commu- jq ^^^^^ P°^' depending on appUcation of target umt 

nicator unit 46 configured such that processor communicates such as hand-held use, or couplmg to medical instrumen- 

medical and/or tracking data and other data about monitored tation. 

object to professional medical or other care-giver disposed As described above, target unit 4 may include processor 

at controller 6 via communicator 7 and network 8. 48 and storage 49, as well as communication device 46 

In embodiment where object 2 is moveable and target unit having one or more operational modes, such as cellular 

4 is attached to or moves conespondingly or portably with phone, email, browser, fax, and/or 2-way pager. Storage 49 

object 2, target unit 4 includes locator unit 46. Locator 46 may be implemented using digital video disk (DVD), 

preferably is implemented using general navigational func- so-called smart card format storage, or other conventional or 

tionality such as radio triangulation functionality relative to proprietary storage or memory device, 

local radio signal sources, or GPS receiver relative to FIG. 3 shows block diagram of controller 6. Preferably, 

satellite signaling sources, for determining location of target controller 6 is implemented in personal or portable computer 

unit 4, and thus correspondingly of moveable object 2 or other conventional processing platform including output 

physically associated therewith. GPS receiver functions device and drivers 60 (e.g., display monitor, speaker, 

according to standard intemational telecommunications pro- 3-dimensional virtual reality (VR) and/or holographic 

tocol in functional cooperation with orbiting satellite signals ^ display, etc.), input device and drivers 169 (e.g., 

to calculate positional vectors, which standards are hereby touchscreen, keyboard, buttons, mouse, microphone, 

incorporated by reference. camera, etc.), microprocessor 48, and storage 49. Storage 49 

In this embodiment of target 4, locator 42 couples to may be implemented using digital video disk (DVD), 

communicator 46, which preferably include digital wireless so-called smart card format, or other conventional storage or 

transceiver, such as conventional or proprietary cellular 30 digital memory device. 

phone-type radio connectivity to associated radio base sta- Additionally software 66 therein includes operating sys- 
tion representing communicator 7 coupled to network 8. tem such as preferably Microsoft Windows or other con- 
Hence, object 2 observation and position data from target ventional operating system, Interact browser software for 
unit 4 is accessible by controller 6 via network 8 and accessing and communicating with world-wide web URL 
communicator 7. 35 sites, as well as innovative instruction code and any related 

In particular, communicator 7 wireless radio communi- firmware or circuitry/equipment for analyzing and/or pro- 
cation functionality may be provided through conventional cessing data according to preferred embodiment one or more 
base station, network hub or functionally equivalent network ^ of following functional modules, as described further herein: 
or communications equipment of cellular phone, trunked^ network and data communications 161, object and map 
radio, wireless local loop, and/or Internet data service pro-^ 40 database structure 161, object movement processing 163, 
vider. 'Air interface between communicators 7, 46 may security management 164, electronic transaction processing 
comply with standaitl radio protocol (e.g., TDMA, CDMA, 165, diagnosis and/or corrective tool 166, performance 
GSM, CDPD, IMT-2000, etc.), which standard documents report updater 167, and visual object analyzer 168. 
published on-line or hard-copy are hereby incorporated by Such modules are generally user customizable and adapt- 
reference. 45 able according to particular need for object surveillance. 

For example, cellular phone or pager functionahty io'^ Further, such modules may be combined into common 

communicator 46 in target unit 4 may transmit navigational q seamless programs or partitioned into multiple distinct coop- 

or position signal provided by locator functionality 42 16 crating program components. Moreover, such modules 

communicator 7 during conventional cellular or pager roam- reside actually, in whole or in part, in controller 6, associated 

ing or signaling protocol with local radio base station or cell 50 storage peripheral device, or other processing machine or 

site to report current call or phone status or location. In this other such controller coupled thereto or accessible through 

regard, wireless communication service and Internet service network 6. Additionally, to improve program performance, 

provider could be substantially same entity. Controller 6 thus one or more of such modules may be omitted or uninstalled 

receives object and object position data via network 8 and/or from controller. Furthermore, modules in software 66 may 

via servers 5. 55 be provided in layered or hierarchical arrangement. In this 

OptionaUy, accelerometer functionary is included in manner, low-levcl core functionality is provided by database 

locator 42 to indicate object acceleration in various direction structure 162, object movement module 163, visual analysis 

(e.g., X, y, z directional axes), particularly actual time and module 168 and object diagnosis tool 166, and next-level 

relative direction of such object movement during start or functionality is provided by security module 164, commu- 
stop events. Preferably, accelerometer signal or data indica- 60 nication module 161, transaction module 165, and report 

tion of active or relative movement serves to trigger more module 167. 

accurate object position calculation, e.g., supplemental to Preferably, browser software functions according to com- 

and compared with other navigational measurement such as mercially available browser product such as, e.g., Netscape 

GPS position calculation for object at certain time to verify Navigator or Microsoft Explorer, or any other functionally 
correct or more accurate object location. Preferably, accel- 65 equivalent means for accessing Internet, intranet or other 

erometer measurements are initially calibrated more accu- conventional or proprietary LAN/WAN website, network 

rately to coordinate with such other navigational schema. node or IP address. 
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Controller 6 or Other user selection and viewing of desired preferably using controller system, target unit 4, or GPS 

objects 2 to be monitored are facilitated by invoking or receiver generated clock for providing accurate synchroniz- 

clicking on one or more websites, address or corresponding ing timing signal, and thereby minimizing possible network 

graphical hot-link icons provided or updated by target unit signaling latency. 

4. Controller 6 access to one or more objects 2 may be $ visual and/or' object movement data from sensor 44 

provided mduectty through mtemediate or topical websiut deludes symboUc or graphical .epresentation of one or more 

or particular page associated with one or mote objects 2 ^.o^tored object 2. Such representation may include pre- 

associated location, object grouping, or other related object . c j . . . , . . , j j l 

attribute for locating/searching, or otherwise monitoring defined or customizable avatar symbol or reduced thumbnail 

certain select objectfs) 2 ^ ^^^^ "^^^^"^^^^ P'^*^- 

Optionally, database structure 162 in software 66 of at ''"^'^ topological map overlay, inchiding posiUonal or 

least one controller 6 provided in integrated system includes **^["P^^^* textual or symbolic tags or identifiers associated 

network searchable (e.g., having IP-addressable sites, links, ^^^h particular objects or detectors proximate thereto. For 

address subsets thereof, or other deterministic network ^^^Pl'^' ^''^^^ * associated object 2 

access scheme) listing or set of controUers and associated ^oc&\ion relative to designated home or base location may be 

users, target units and associated objects, detectors and illustrated against map. 

associated servers. Preferably database structure is provided Associated graphical and any corresponding textual map 

asynchronous storage device array format to reduce access ^^^^ "^^y include digitized cartographic, street, building, 

delay thereto, including any object or set thereof description, ^oom, layout, elevation, depth, or other multi-dimensional 

associated movement, schedule, timing, observable images, <^ata. For example, monitored person object may be 
non-image conditions, states, fees, etc. In this way, prefer- ^° Ulustrated as having entered building at particular time, 

ably Internet search ability of particular object or object set Preferably, current or updated map data, including any 

as well as monitored information such as multi-media associated directions, commute traffic or parking data, are 

images thereof are achieved, assuming proper authorizations downloadable from controller 6 or other central map data 

apply as described herein. source to one or more mobile target unit 4 for use therein. 

Database structure 162 may include schedule or other Preferably, input 169 is implemented using selection entry 

temporal scheme associated with one or more object interface functions, such as on-screen buttons for indicating 

presence, movement and/or other observed condition in one tiser preferences or text entry in response to various queries 

or more monitored locations. In this way, control software from operational control soflwarc 66. Control or perfor- 

66 or user thereof may compare determined object presence tnance report 167 functions to generate personalized or 

or other surveillance measurement thereof against such standard on-screen, hard-copy print-out, file storage or 

scheduled object activity. This allows determination of transfer, or other manner for delivering analytical, 

compliance, as well as recording or alerting appropriately, diagnostic, statistical, historical, predictive, probabilistic, or 

for example, when object delivery is late, early, on schedule, other formatted text or graphical report relating to object 

unscheduled, or absent. Furthermore, by determining actual monitoring operations of overall integrated system managed 

monitored object schedule, control software 66 may provide by controller 6. 

for more efficient local resource allocation and coordination Similarly to mobile target unit 4, controller 6 includes 

with such monitored object or set thereof. detector or other physical or vital medical sensor interface 

Additionally, software 66 may employ one or more Intel- 169, location-determining device 160, such as GPS receiver, 

ligent software agents to function in conjunction with data- local radio signal triangulation functionality, or accelerom- 

base 162, communications module 161, transaction module eter device for generating actual or relative positional signal, 

165, or movement module 163, as well as other modules and communications device 69, such as conventional cellu- 

included therein. In this manner, for example, upon con- lar phone or pager functionality. 

necting controller 6 and/or mobile unit 4 to Internet 8, one Additionally, such communications functions 69, 46 may 
or more such agents may act on behalf of such controller 6, 45 include portable local number, universal identity module, or 

mobile unit 4, or associated object 2. other identifiable va]ue(s) for communicating with particular 

In particular, such software agent(s) effectively extend authorized or associated user. Such local portable number(s), 

functional reach of various module functionahty in soflwarc including any prepayment credit value, may be stored on 

66, such as by: negotiating with other software agents over smart card or functionally equivalent portable device which 
network server connections with one or more fixed detector 50 is readable electronically by controller 6 or target unit 4. 

or server sites and/or mobile target units to schedule Preferably, communications module 161 fiinctions adap- 

monitoring, coUaborative chat or meeting times; or coordi- tively to initiate, esiabtish, modify, and coordinate user 

nating timely delivery of product, services, or other elec- communication or messaging involving text, voice, video, 

tronic data or signaUng. image, or other electronic synchronous or asynchronous 
Additionally, such agents may serve to retrieve (i.e., 55 signaling between controller 6 and mobile target unit 4, as 

"pull" or seek specific information such as certain objects or well as any other processor or peripheral coupled to network 

medical patients or their locations, movement patterns, 8. Hence, polling of available objects, detectors, controllers 

schedule, or other monitorable attributes), watch or "push" or other networked resource in integrated system, as well as 

for specific information (e.g., appropriate medical treatment providing recognized or unrecognizied voice or video over 
or medication, target banner advertisements or other com- 60 data channel, signaling or network operation are schema 

mercial message or reports aligned with known or expected contemplated within the scope of preferred implementation, 

interests of particular mobile objects), provide integrated Additionally, communications module 161 may serve ^ 

system utiUty help and diagnostics, or shop or prescribe for adaptively to enable scaleable collaborative or grt)up chal 

fixed products or services according to object user prefer- communication between authorizicd multiple entities 4,6^ 
^nce. 55 coupled thereto. This configuration may arise in multi-cast * 

In this way, proper timely delivery of hazardous or mode wherein multiple observers monitor common object ^f^ffji\^£AiJtM 

movement activity. Also, upon detection of emergency or O j 



perishable mobile objects, for instance, may be ensured, movement activity. Also, upon detection of emergency or 
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Other urficnl messages (e.g., 911 phone calls from target unir compoQents communicate preferably through Internet pro- 

cell phones!>, relevant oD|cct locanoa. movement, or other tocol and equipment. Such integrated system enable flexibly 

conditions are communicated or forwarded immediately . scaleable approach to monitoring object movement therein, 

^ uch mcssa^g may be treated as high-priority to approi jo achieve effective integration, movement module 163 
priatc authoriUes located proximately to monitored obiecTi rf 5 and database 162 preferably cooperate functionally to des- 

^tress. ' ignate one or more object for tracking. Initially, each tracked 

Object and map database structure 162 functions to deter- object is statically represented in database with unique 

mine and store each monitored object representation, as well object identifier, start location, monitoring time at such 

as prior, current and likely future locations, for example, as location, as well as other measurable object conditions, such 

provided from initiahzation values, fixed detector site mea- as direction vector, height, etc. For each tracked object, 

surement or other observation signals, mobile sensor mea- module 163 determines whether such object has associated 

surement or other observation signals, console or mobile target mobile unit 4 and/or detector server site within range 

unit user entry, as well as processor calculated, estimated or to observe such object. Mobile unit 4 may be registered in 

projected values. Such database information is useful for database 162 to indicate association with particular object, 
subsequent read, write, modify, delete, restrict, or other data J5 Object initial location (e.g., Cartesian coordinates) may be 

access operation. compared against current list in database 162 of functional 

Data structure may be implemented in one or more detector server sites determined to be electronically acces- 

constituent data structures, such as various object-oriented sible to Internet and physically located within range to 

and/or relational data tables. Preferably, stored object data is observe object. 

maintained in dynamically or simultaneously accessible and Continuous or dynamic streaming information about par- 

updatable database format such that multiple object and ticular object(s) may be obtained as well, for example, in 

object related information (e.g., movement, condition, live video or audio feeds. Object designation may be 

billing, etc.) may be read and processed by more than one invoked by user request to locate particular object or set of 

object processing instance or process. objects. Initial values may be user-specified, derived from 

For example, monitored object data format may be pro- pre-defined object movement schedule, or actually deter- 

vided including any of the following values: object name, mined from integrated system field measurements (i.e., 

unique object instance or identifier, object group or mobile unit or detector sites). Accurate timings may be 

association, object interests or requests, object physical or generated from or synchronized with global clock signal 

medical condition, object financial status, initial location and available from GPS receivers. 

time, subsequent locations and times, system flags or other Then, after certain time interval elapsed from initial object 

error indications associated with object, object mobile unit monitoring event, next object monitoring event occurs, 

identifer, object digital image, video and/or audio informa- Subsequent object surveillance sessions may occur accord- 

tion which may be pre-recorded or delivered from current ing to random, regular, intermittent, or otherwise scheduled 

"live" broadcast or transmission. or triggered times (e.g., by mobile accelerometer or fixed 

Additionally, database 162 maintains associated map motion detector activates in response to object movement), 

databases such that object locations may be overlaid thereon Also, sessions may be repeated to provide iterative calcu- 

as appropriate to show position and movement. For lations of more refined and accurate measurements of object 

example, office or residential facility floorspace, rooms or movement, for example, using smaller time intervals, 

locations are mapped to illustrate relative object movement So, during next event to monitor tracked objects, new 

therein. In particular, movement processing module 163 measurements are obtained from any associated target 

functions programmably to track object positions and rec- mobile unit 4 and/or detector server sites within observation 

ognize positional variances indicating relative movement, range. Preferably, substantially during such monitoring 

including horizontal, lateral, as well as vertical movements. event or period, mobile unit 4 provides GPS location infor- 
Preferably, set of monitoring rules or parameters apply to 45 mation associated with tracked object, while observing 

restrict or expand object surveillance scope, such as speci- detectors deliver one or more image of tracked object. Such 

fying various allowed schedules, locations, any monitoring integrated approach provides corroborated surveillance, i.e., 

or metered fee charges, monitorable objects, as well as that target object is evidently observed to be located at 

limiting particular data types, such as video or audio only, or certain location at particular lime, 
restricting access to certain sensitive medical, financial, or 5Q Hence, during normal integrated system operation, 

other private observable object condition or state. mobile tracked object activity traveling from one observa- 

Movement processing module 163 determines when cer- tion area to another area may serve to trigger and cause 

tain object(s) 2 being monitored by particular detector(s) has movement module 163 to activate such neighboring fixed 

moved or otherwise likely to roam according to determined detector server sites. In another case, console user merely 
actual movement vector of such object into new detection 55 requests to know which objects are presently in an observ- 

area, unmonitored area, or overlapping area associated with able area (i.e., query: who are all here?). In such case, fixed 

different detector. In this manner, control software 66 may observation data may serve user to trigger and cause one or 

recognize object movement using module 163, and thereby more mobile units disposed in such area to submit their 

process 208 object movement information to provide proper information (e.g., associated object identifier, location, time, 
determination 210 and any appropriate post-processing go ^Ic.) As appropriate, database 162 is updated when certain 

thereof. For example, roaming object or object set may be observation detector or sensor sites are triggered to monitor, 

handed-off to neighboring or next closest or available To increase degree of remote surveillance further, other 

detector-server site, or potentially colliding object vectors detector also within observing range, but having different 

may be so detected and thereby avoided in time. viewing angle, zoom, lighting, etc., may be caused to 

In accordance with an important aspect of present 65 monitor target object. Other sensors in associated mobile 

invention, fixed imaging array of detector sites operationally unit may also be caused to monitor target object in additional 

integrate with locatable mobile units. Fixed and mobile ways, e.g., by activating medical instrumentation to take 
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patient vital measurements. Orchestration of fixed and 
mobile observation measurements upon tracked object may 
be specified on case-by-case basis depending on surveillance 
application. 

For example, system flag may be issued or displayed 
when tracked object is determined to be absent from sched- 
uled location monitored by certain detector at scheduled 
time. Additionally, error may be indicated when same object 
identifier is determined to be detected at multiple different 
observation sites, but at substantially same time (since this 
condition may suggest fraudulent or pirated object or asso- 
ciated mobile unit). Furthermore, urgent notice may be 
delivered to console when emergency is signaled from 
object through fixed or mobile observation channels. 

Preferably, movement module 163 continues operating to 
determine and update tracked object location and times, 
even when one or more observation values from various 
fixed or mobile detector, sensor, or locator functionalities are 
temporarily disengaged or inaccessible. During such down 
periods, movement module 163 may use last stored infor- 
mation about particular tracked objects available in database 
162, or provide extrapolated or predicted object location at 
future times based on schedule or most recent movement 
extrapolation (e.g., according to object direction, speed, 

25 

Security and access processing module 164 functions 
programmably or adaptively to limit, encrypt (e.g., using 
public or private key encryption scheme), or secure user 
access to system, particularly database 162. In this way, 
individuals seeking to monitor certain objects, for example, 
may be pre -authorized and/or authenticated using one or 
more digital certificate. Such digital certificate may include 
person name, address, bank brand, timestamp, public key, 
and is cashed and signed by issuer digital signature. This 
screening method may apply to health-insured or multi-cast 
designated member observers or excluding un-insured or 
under-aged children or other vulnerable or unqualified group 
or objects from pre-specified monitoring or commerce trans- 
action activity. 

Security access criteria for program rating and screening 
may comply with federally or privately published standards 
for so-called V-chip technology, which are hereby incorpo- 
rated by reference. In special or emergency circumstances, 
security to object database and recorded and/or actual object 
surveillance and movement data may be over-ridden (i.e., 45 
trap door) to provide access to general or specific object 
information. 

Security and access module 164 may determine or rcc"- 
ognize authorized, preferably according to location-based 
<^nd/or associated object movement constraints, controller 50 
i^^oMiser or mobile object seeking to communicate with inte- 
^ grated system through authenticated sensor or input via 
0 acceptable voice pattern, finger-print pattern, handwritten 
signature, magnetic or smart card signal, etc. For example, 
module 164 records and issues alert w faenintruder target unit 55 
4 is determined or appears to be monitoring object 2, based 
on geographically correlated object/target unit 4 movement 
provided to console 6, i.e., although unauthorized to do so. 
Additionally, access to certain detectors or corresponding 
,es where current or historical access activity is relatively 60 
high, or results in noticeable network congestion, may be 
limited. Purpose here is to provide dynamic load balancing, 
whereby network usage is collected, measured, analyzed, 
and re -allocated to different available networking and detec- 
tion resources. 65 

Fraud detection feahire may be included to identify, 
record and alert aoain.<^t unauthorized user, input pattern, or 



other predictable or unrecognizable signamre or electronic 
behavior. Integrated system attempted and/or successful 
access thereto via network ports, servers, or other access 
connections are logged and traceable, preferably by general 
or specific geographic location. Furthermore, object moni- 
toring services arc preferably restricted according to speci- 
fied rules, as described herein, including authorized 
observers, times, locations, objects, etc. Preferably, module 
164 employs conventional network firewall protection. 

Transaction processing module 165 functions preferably 
during object processing and/or diagnosis to manage user, 
advertiser, vendor service bilUng, or other commercial trans- 
actions using integrated system. For example, transaction 
processing module 165 may initiate, activate, update, 
combine, separate, terminate or otherwise process user 
accounts associated with one or more user controller 6 or 
monitored objects 2, or measure and/or restrict actual object 
2 or controller 6 usage or monitoring time, range, location or 
scope. This is achieved preferably selectively according to 
specified billing or pricing schedule, or other rate scheme to 
provide regulated user charges on credit or corporate 
accounts as well as location-based and temporal-based 
charges. Transaction processing module 165 interacts 
through textual, graphical, sound, and/or video interface * 
with user through appropriate input and/or output function- ^/vU^^ 
ality^of controller 6, and/or object 2 through target unit 4. i-viV^^^ isX^**^ 

Moreover, t ransaction processinfi module 165 may record ^^^..^w) t » 
and analyze actual oast or current, or potential future msiVK&.i /"^^ f\OJ^^^^ 
demand, w ants or needs according to user (user controller^ I 
and/or object set) demographics, geographic location, move- | 
ment pattern, preferences, consumption, transaction, or ^nt^X 
other commercial activity, behavior or information, particu- *^ SStW^4^^ 
larly arising from object monitoringusing integrated system. . fl 

Hence, important objective is to provide customer-centric^ ^'^^r 
electronic transaction scheme;^ 

Optionally, transaction processing module 165 in coop- 
eration with one or more other modules in control software slT^TJt^ 
suite 66, provides real-time, dynamic, targeted and/or selec - ^fUUlO*--* 
tive notification, delivery, advertising, educational, pricing,^ uCloxXM^KC^ 
inventory quantity, and/or other business sales, distribution" TD V^^-^-^lW 
or marketing interactive or static text, graphics, voice, and/or^^ | 
video data information and/or associated electronic signal- r^AeX^WttK^L 
ing pertaining to one or more commercially available or^ Vvtl^ I 
soon-to-be-available product and/or service? ^^VtAA"^^ 

It is contemplated further that such solicited or unsolicited 
product (e.g., text document, such as books, news, sports, or 
stock report; graphics, such as greeting card, or other 
artwork; data, such as research databases, person or item 
listing, or other electronic file transfers; sound, such as live 
or recorded voice or instrumental music or newsbroadcast); 
or service (e.g., professional services, electronic tool access, 
commercial U*ansactions, etc.) may be delivered electroni- 
cally. Such delivery could be through on-line Internet 
distribution, publishing or access otherwise via Network 8 to 
user controller 6 or object 2, as monitored according to 
present invention. 

Furthermore, in such operational mode, transaction pro- 
cessing module 165 may depend on known (e.g., based on 
reported or requested consumer want or need data) and/or 
expected (e.g., based on demographic, social, or other rela- 
tional group behavior and/or predicted, extrapolated or 
adaptively calculated consumption pattern thereof) interest 
of one or more object 2 or user controller 6, within certain a ^ 1 

observable or monitorable group or surveillance location or fi/XMXS^ 
region." This applies particularly in shopping] initiating, ^Ii^^* 
bidding, negotiating, accepting, modifying, or completing 
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oae or more commercial or private transaction, initiates or 
offers (Le., unsolicitedly " pushes"^ commercial informatioD 
to one or more potential buyer controller 6 or object 2; or 
responds or replies (i.e., solicitcdly "oulls"^ bv deliverinp 
c ommercial information to one or more potential buyer s 
controller 6 or object 2, or by responding appropriately 
thereto (e.g., auction bid, acceptance of offer, counter-offer, 
request for more product or service information, etc.). 

Hence, in accordance with one aspect of the present 
invention, improved electronic commercial transaction 10 
methodology is provided generally such that one or more 
potential buyers and one or more potential sellers (i.e., 
w herein any buyer or seller may correspond to user con - 
t roller or target unit obiect having certain observabte or 
monitorable attributes, as described here in) communicate 15 
digitally through Internet or other substantially equivalent 
networking facilities. 

Jn particular, s uch integrated system for enabling remot e 
objec t surveillancc-bascd commercial transaction is prefe r- 
a bly achieved by considenng potential buyer or o'Elcc t '^^ 
movement relat ive to fixed or mobile resources (i.c., prod-^ 
ucis or services), ihereby optimizing localized consumed 
satisfaction. For example, usinc; integrated system , mobile 
"yellow pages" or other local vendor or available mjul^ 
hsting, possibly provided in local mobile or fixedyk iosP^ 
transaction station for obtaining certain commercial dSta^^ 
actually completing transaction, improves likelihood of^ 
matching mobile consumer wants or needs with nearby 
product or service resources. In this manner, module 165 
may only bill customer for actual usage time or benefit 
derived.- 

^/^O Diagnosis a nd/or corrective -action toot^ 166 functions 
g enerally to obtain and analyze integrated system status as 
w ell as object monitored dat a, particularly prior, current, and) 
predicted object position, movement, image, as well as other 
physically sensed information. A t any lime, tool 166 may 
co nduct network configuration and connection test to "pino^ '/ 
or 3herwise sense state , condition, status, location, of one or 
more controller, detector, server, target unit, or object oth- 
erwise connected thereto. 

Tool 166 may adaptively provide positional or directional 
functionality generally to alert au thorities or other interested 
parties when undesirable "object or movement is monitored. 
Examples may include: when associated child, wheelchair, 45 
hiker, golfer, luggage or other vulnerable or valuable person/ 
item object is recognized to be located, having moved, or 
imminently expected to move outside familiar or safe loca- 
tions; or when associated delivery, transport, or emergency 
or other service vehicle object is recognized to be located, 
having moved, or imminently expected to move outside 
proper or more efficient street trajectory, path or other 
preferred route. 

Optionally, diagnosis tool 166 may programmably simu- 
late expected object behavior. Simulation may logically, 55 
functionally or behaviorally model movement, or other 
monitored activity, based on interpolated values between 
actual detected values, or extrapolaU pg further movement in 
time, for example, according to aclual historical detected 
values of object movement. In this manner, diagnosis tool 50 
166 may include one or more simulation models of certain 
object or object sets 2 using monitored object data from 
fixed and/or mobile detection sources. Depending on simu- 
lated or predictive object behavior, controller may recom- 
mend or take corrective action. 55 

Additionally, in medical diagnosis context, it is contem- 
plated that integrated system may be employed locally or 



remotely by qualified medical professionals to monitor and 
diagnose patient vital conditions from monitored signals 
using sensor detector 44 in mobile unit 4 coupled to con- 
troller 6 through network 8, For example, emergency medi- 
cal data such as severity, timing, etc. may be relayed directly 
from mobile target unit 4 at crash site or ambulance to 
hospital emergency facilities. 

Moreover, in commercia l l^^psactinn or direct marketing ' 
context, it is contemplated that integrated system may be 
e mplove d locally and/or r emotely to c onduct obiect 
movement-based or other monitored attribute -based tarpeted 
p roduct or service advertisement, offer, counter-offer , 
acceptance, or other communication between buyer and 
seller. Advertisement may be invoked electronically for 
on-line viewing in banner display format, preferably tar- 
geted according to known or expected object or user 
demographics, behavior, or request. 

Hence, when object 2 is associated with customer of 
certain product or service provided by controller 6 user 
associated with vendor thereof, integrated system is appro- 
priatc'for providing improved services. Such services may 
include customer interaction, communication, tracking and 
support, 'for example with respect to automobiles, to notify 
regularly scheduled times for car repair service or part 
replacement such as battery of object car product, or detect 
unscheduled object activity or monitored conditions, such as 
electronic signal mdication of flat tires, discharged emer- 
gency air bag, vehicle accident, empty fuel gauge, exceeding 
certain speed limit, stolen vehicle operation (e.g., hot-wired 
ignition), etc. 

Performance report module 167 serves programmably to 
define, format, and generate requested, personalized, pre- 
defined or other useful textual and/or graphical information 
corresponding with operational attributes and statistics of 
integrated system operation. For example, as scheduled or 
requested, reports are provided regarding excessive object 
presence or movement within particular area, object move- 
ment update with respect to one or more monitored patient 
condition, residential or commercial faciUties and grounds, 
vehicle or transit paths condition, goods production or 
inventory, etc. Hence, to improve inventory management, 
module 167 may provide report detailing status and capacity 
for drop shipments, just-in-time inventory, from-stock 
inventory, etc. 

Data reporting may provide real-time delivery of current 
object location and movement relative graphically to 2 or 3 
dimensional map overlaid thereon. Object imaging and 
locations from detector servers and/or sensor measurements 
and locations may be displayed on console screen as well. 
Emergency, enror, or other system flags may be indicated. 

Visual analyzer module 168 is optional and functions 
programmably to process, preferably in mulli-dimensions, 
digital image or video information to attempt to recognize, 
store, compare, or otherwise process visually observed 
information regarding monitored objects. Module 168 pref- 
erably serves to detect object movement or activity within 
monitoring scope of certain detector sites. This may be 
achieved at certain times by comparing or correlating 
observable similarities or differences between initial and 
subsequent surveillance data therefrom. For example, mod- 
ule 168 may serve object image queries and attempt to 
recognize, retrieve from image database, or otherwise cap- 
ture image of person or object associated with target unit 4 
determined recently to have entered detector observation 
scope, or interacted with mobile target unit 4 sensor 44 or 
fixed detector 4 by communicating therewith through voice 
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message, e-mail, facsimile transmission, smart-card or key is conducted. Database including object status and delected 

entry, finger-print tactile sensing, etc. movement thereof provides accessible archive to determine 

In FIG. 4, flow-chart shows operational steps, including object movement for subsequent processing. Fixed system, 
initial setup 200 of integrated system configuration (e.g., however, may provide limited object surveillance and par- 
coupling controller(s), detector(s) and server{s) to Internet, s Ucularly movement capabUity, depending on efifecUveness 
providing identifiable network address for each coupled ofmoving object recognition. Preferably, module 168 detcr- 
detector, target unit, controller, etc.). Additionally, initial' mines empirically likelihood indication of correct/inconrect 
setup may include database initialization, system ping test^ object recognition, for example, depending on historical 
detector polling and calibration , security access dcrimtions' matching database of prior similar objects and/or conditions, 
or authorizations, penrailied object monitoring rules, billing Accordingly, in part to provide improved object move- 
schedules, taxation rates, and object or map database ment determination, mobile system is overlaid upon such 
f defiaition, as specified adap lively herein for dififerent object fixed system. In this way, each tracked object 2 is physically 
Vclass, locations and/or times. ' accompanied by target unit 4, which includes accurate 

Preferably, network 8 connection by controller 6 to server location-determination facility, sensor apparatus for observ- 

5 and detector 3, or to target unit 4 through communicator ing object 2, and wireless communication transceiver for 

7 is substantially continuous or dedicated, although may be linking to network 8 and controller 6 through fixed com- 

estabhshed from time to time, for example, through con- municator 7 coupled thereto. In this mobile subsystem 

ventional telephone dialup modem, Integrated Services overlay, remote object surveillance and movement are sig- 

Digital Network (ISDN), digital subscriber Line (DSL), nificantly enhanced by allowing console 6 to determine 

cable modem, lOBase-T, or other remote access procedure more definitively from target unit 4 identity, location, and 

to or from Internet Service Provider (ISP) switch or router. other physically measurable condition of associated object 

Optionally, to provide improved system reliability and ^' 
fault tolerance, it is contemplated that integrated system may More particularly, in accordance with an important aspect 
employ redundant, mirrored, or shadowed configuration of the present invention, console 6 may coordinate remote 
employing identically maintained secondary controller, observation activity at targeted sites. Coordination is done 
including equivalent object, detector, historical, current, by selecting more accurately proximate detector-server 
predictive database, conditions and state. In this manner, nodes to track mobile objects 2 according to corresponding 
when primary controller 6 somehow fails, or encounters object location delivered by associated target unit 4 to 
substantial performance problems, secondary controller may console 6. Hence, in integrated fashion, console user lever- 
be activated to provide fail-safe or uninterrupted object ages existing global Internet connectivity as well as geo- 
monitoring service. graphically distributed detector and server set coupled 

Additionally, controUer 6 may serve to reduce system thereto. Also, wireless mobile flexibility is provided by 

congestion arising from many qualified users attempting to properly equipped target units attached or included physi- 

monitor the same object(s). This result may be achieved cally with certain monitored objects, 

particularly by limiting total number of monitoring users Firstly, based on v arious initializing factors for dctermin- 

from simultaneously accessing common website location ing object location or surveillance, such as initial polling 

representing certain object detector locations, or by provid- results from one or more target units 4 or detectors 3, 

ing distributed or shared access to common website location retrieved object site information, object movement search 

among multiple monitoring users, such as in multi-cast results, or initial, preferably authorized, detected observa- 

mode. tions or other monitoring surveillance 202 performed on 

Preferred integrated system operation and methodology subject object(s), initial positioning or surveillance for one 

achieves improved remote object surveillance and move- or more object may be determined. Such initial information 

ment tracking generally in an overlaid fixed and mobile may be displayed graphically preferably relative to corre- 
networked infrastructure. Fixed network includes console 45 spending map data, based on electronically observed 

units 6 connected via Internet 8 to multiple electronic measurements, data, signals, or pre-defined object context or 

detector units 3, disposed at strategic observation sites fixed related values, relative to map database nr other cnmparahle 

about scheduled or possible paths wherein mobile objects 2 contextual database. 

may traverse from time to time. In this fixed arrangement, Monitored object set may also be defined according to 
object surveillance is achieved as console accesses servers 5 50 user-requested search terms for finding and/or prioritizing 
coupled to one or more corresponding detectors 3 to monitor relevance of specific or qualified object members of par- 
objects 2 within observable range. ticular class or other searchable attribute, e.g., find all 

In particular, software 66 specified herein includes visual doctors in "94062" zip code area, or find "Elsa" the dog 

module 168 and movement module 163 which may provide (who may be wearing a trackable target unit on dog collar), 
certain object recognition and movement tracking thereof. 55 According to preferred methodology, object monitoring may 

such that when particular object moves, for example, from be invoked by causing controller browser to initiate session 

one observation area to neighboring area, console monitor- call for accessing website address associated with server- 

ing switches from one detector to another detector having detector associated with particular object, 

improved observation position. Additionally, in case of Preferably, database 162 maintains one or more object 
object movement over relatively longer distances, module go representation, instance, state, condition, movement, and/or 

163 serves to track object progress, as well as various object other associated monitored information, such that at any 

condition changes, such as fuel level, health condition, cash particular moment, multiple objects 2 may be monitored and 

reserves, etc. processed effectively in parallel according to operational 

In significant part of preferred methodology, object move- sl^ps of FIG. 4. 
ment monitoring is achieved by conducting initial surveil- 65 Monitored object set may be assigned expected lime, 

lance of object set. Then, object is allowed lime or oppor- location, or other physical conditions, such as medical stale, 

tunity to move, and follow-on surveillance of such object set each assigned value or substantially similar value within 
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allowable range, say +/-15% variation. In this case, initial 
values or conditions may be set in integrated system, such 
that proper values are monitored accordingly, for instance, 
activating video detector(s) located most closely to particu- 
lar monitored object. 5 

Next, object movement or transition may occur 204 after 
or during a specified time period, which may be regular, 
random, triggered, or pre-scheduled. During such temporal 
period, object physical state, such as location, vehicle, 
luggage, patienC nanny, bank teller, vehicle traffic, or pris- 
oner condition may change. As appropriate, GPS receiver in 
mobile unit 4 may provide universal clock signal source for 
relatively accurate synchronization within integrated sys- 
tem. 

Then, based on secondary authorized and detected obscr- 
vations or monitoring surveillance 206 performed on subject 
object, or s econdary polling results therefrom, secondary 
position or condition is determined. Preferably, integrated 
network configuration determination or ping test u pon one 
or more assodaled controller, server, detector, or object jo 
coupled thereto is conducted to recognize current network 
participants and corresponding configuration, conditions or 
stales. Hence, when such tfi.<;ting reveals defective or unre- 
s ponsive ^ gf^'"'' y^^*" ^^^'' j fiv^^ '= it6 is deactivated 
and removed from active database, until problem is ^5 
resolved , i 

In accordance with an important aspect of present 
invention, integrated approach combining positional data 
(e.g., processed GPS or other triangulated radio signals) and 
visual data (e.g., observed real-time video or other digital 30 
image), or other physical sensory data (e.g., patient medical 
vitals) are obtained. Such data are obtainable by set of fixed 
or relatively fixed (e.g., video cameras) or mobile (e.g., GPS 
receivers) disposed at various locations about monitored 
object presence and activities. Such integrated network of 35 
sensory and positional detectors may be arranged along 
streets, highways, bridges, intersections, elevators, 
buildings, restrooms, classrooms, hotel, offices, hospitals, 
prisons, storage warehouses, churches, stores, and virtually 
any other practical location of monitorable human or animal 40 
activity. 

To address potential individual privacy sensitivity or 
objection to being monitored, certain locations may be 
omitted from detection, or require approval prior to or while 
being monitored. Additionally, monitored object(s) may be 45 
provided current hst of monitoring user source names, class 
or total number. 

Next, object analysis and movement processing is per- 
formed and/or graphically displayed 208. Here, relative 
movement, acceleration or other object physical condition 50 
shift or other detected transformation is accomplished when 
spatial or other physical variance between temporally spaced 
measurements is detected and accordingly shown on-screen 
preferably animating object movement against relative map 
data. Preferably, object recognition and condition 55 
monitoring, including any monitored changes thereto, are 
achieved. Such object processing is achieved via visual, 
video, or image processing, as described herein for optional 
module 168, to recognize or correlate particular observable 
object attributes, and/or by GPS or other radio triangulation 60 
positional signal information and any corresponding sensed 
object identifier or signature information, as determined 
over different or scheduled monitoring times. Preferably, 
any substantial difference of measured location values are 
reconciled in favor of GPS location calculation over other 65 
position or navigation scheme, particularly when selective 
availabihty (SA) thereto is set substantially to zero. 



Object movement relative to appropriate map overiay 
may be illustrated, for example, in two or three dimensions 
statically or dynamically. In this way, each object instance 
may be symbolically represented by reduced-size or thumb- 
nail graphical or textual icon or avatar on output display. 

Then, object movement diagnosis, corrective-action, or 
transaction processing is performed 210. In this regard, data 
processing may be case- or application-specific as described 
herein to the extent that user or object condition changes 
warrant case-specific diagnosis, correction, remote repair, or 
transaction services. 

In accordance, with one aspect of present invention, 
improved methodology and system are provided to deter- 
mine remote and/or local mobile object movement. Such 
movement is based on monitored or detected data from one 
or more fixed detectors coupled to Internet or other net- 
working interconnection. Further, such movement determi- 
nation is employed in subsequent process activity, such as 
targeted commercial transaction, remote health care, public 
or private facility, goods, mobile, or staff surveillance. 

For example, upon indication by mobile target unit 4 of 
low-power source condition, integrated system facilitates 
via module 210 sleep mode operation and/or provisions for 
localized power supply by controller 6 notifyingiparticular:) 
target unit 4 with low power source via network 8 and^ 
communicator 7 wireless connection of convenient or 
nearby re-charge outlet or battery inventory. 

Finally, as shown, performance report may be generated 
and/or delivered preferably according to schedule or request 
as well as targeted delivery site according to requester or 
object locale. Ongoing console display of monitored objects, 
movement, maps, flags, etc. may be provided. Then, data- 
base is updated accordingly 212, for example, when exces- 
sive or unscheduled object presence or movement is 
detected. As appropriate, steps are repeated 213, or adapted 
according to any revised initialization values, to accommo- 
date further object movement. Optionally, software 66 may 
employ neural-based or adaptive learning for high- 
transaction processing for tracking real-time data associated 
with multiple object surveillances and/or movements. 

Therefore, to summarize key features of inventive meth- 
odology and system, following general steps are provided in 
brief sequential format as implemented in preferred solution: 

1. ; Integrated Overlay. Provide integrated surveillance and 
communication system, wherein mobile units are overlaid 
with fixed detector network. Both fixed and mobile units 
are accessible through the Internet. 

2. Fixed Detection. Console user monitors object movement 
through multiple camera detectors coupled through the 
Internet. 

3. Mobile Detection. Console user monitors object move- 
ment through mobile unit sensors and locators coupled 
wirelessly through the Internet. 

4. Obiect Analysis. Control database and software combines 
fixed and mobile object data to monitor object movement 
relative to fixed surveillance sites. Fixed detectors 
observe object presence within certain area, while mobile 
sensor provide more accurate location as well as object 
sensor data. Database tracks historical, cunent, and pre- 
dicted movement of object sets, thereby facilitating object 
search. 

5. Processing Services. Commercial transactions deliver 
products and services more effectively to mobile object 
consumers. Secured access and graphical map outputs 
enhance system usefulness. 

Although the principles of this invention has been illus- 
trated in the prefened embodiment in accordance to a 
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surveillance applicatioD, it is intended that the principles of 
this invention to be also applied to other applications, such 
as patient monitoring, person, vehicle, or property tracking 
and monitoring. 

Thus, the foregoing described embodiments of the inven- 5 
tion arc provided as an illustration and description. It is not 
intended to limit the invention to the precise form described. 
Other variations and embodiments are possible in light of 
the above teaching, and it is thus intended that the scope of 
the invention be limited by the detailed description, but lo 
rather by the claims as follow. 

We claim: 

1. An integrated system for electronically monitoring 
remote objects comprising: 

a controller for monitoring one or more moveable objects; 15 

a plurality of detectors for detecting one or more objects 
monitorable by the controller; and 

a digital network for selectively interconnecting the con- 
troller to one or more detectors; 

wherein a corroborative surveillance of a given object is '^^ 
enabled efifectively by the controller monitoring a posi- 
tional data associated with a mobile position of such 
given object, the positional data being generated by a 
mobile detector comprising a cellular telephone com- 
prising a global positioning system (GPS) receiver 
coupled to such given object when such object is 
moveable within an observable range, and the control- 
ler further monitoring a visual data associated with a 
visible observation of such given object, the visual data 
being generated by a fixed detector uncoupled to such 
given object in the observable range, whereby a user 
monitoring the controller may communicate with the 
cellular telephone during the corroborative 
surveillance, the controller further monitoring a medi- 
cal data associated with physical sensing of the object, 
thereby enabling remote diagnosis of the medical data 
corroboratively with the visual and positional data. 

2. The system of claim 1 wherein: 

the controller comprises a database comprising a repre- 
sentation of each monitorable object, each object rep- 
resentation having a position relative to one or more 
detector. 

3. The system of claim 2 wherein: 

at least one of the detectors comprises a camera for 45 
generating a digitized image signal of a monitored 
object disposed relative to such camera, the controller 
receiving the digitized image signal to monitor such 
object. 

4. The system of claim 2 wherein: 

the controller further comprises software means for 
detecting movement of one or more monitored object 
and modifying the object representation of each object 
detected to move in the database to indicate an updated 
position. 55 

5. The system of claim 2 wherein: 

the controller further comprises a browser interface for 
graphically displaying at least one monitored object 
relative to one or more detector, the digital network 
comprising an Internet network infrastructure. eo 

6. The system of claim 1 further comprising: 

at least one moveable unit corresponding to at least one 
monitored object, each moveable unit comprising 
means for determining a position of such moveable 
unit, each moveable unit coupled to the digital network, 65 
such that the determined position is accessible by the 
controller. 
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7. An integrated system for real-time monitoring of one or 
more remote objects comprising: 

a target unit in proximity to one or more remote objects, 
the tai^et unit comprising a sensor unit, and a commu- 
nication unit, including at least a processor and an 
Internet access application, 

a controller comprising a browser software interface for 
accessing a website comprising remote real-time object 
data associated with the remote object and displaying 
the remote object data on a screen, 

a database comprising a representation of each monitored 
object, and software means for detecting movement of 
one or more monitored object and modifying the object 
representation of each object movement to indicate an 
updated position in the database; 

a plurality of camera detectors for detecting one or more 
objects monitored by the controller, and generating a 
digitized image signal of the monitored object disposed 
relative to the camera, the controller receiving the 
digitized image signal to monitor such object; and 

a digital Internet network for selectively interconnecting 
the controller to one or more camera detectors; 

wherein the oonU:oller remotely monitors a position signal 
associated with a mobile position of a given object, the 
position signal being generated by a mobile target unit 
comprising a cellular telephone comprising a global 
positioning system (GPS) receiver coupled to such 
given object when such object is moveable within an 
observable range, and a visual signal associated with a 
visible observation of such given object, the visual 
signal being generated by a fixed caniera detector 
uncoupled to such given object in the observable range, 
thereby enabling corroborative surveillance efifectively 
by the controller of the given object by monitoring the 
positional and visual signals in the observable range, 
whereby a user monitoring the controller may commu- 
nicate with the cellular telephone during the corrobo- 
rative surveillance, the controller further monitoring a 
medical signal associated with physical sensing of the 
object, thereby enabling remote diagnosis of the medi- 
cal signal corroboratively with the visual and positional 
signals. 

8. An integrated system for electronically monitoring 
remote objects comprising: 

a controller comprising a browser software interface for 
monitoring one or more moveable objects and graphi- 
cally displaying at least one monitored object, a data- 
base comprising a representation of each monitored 
object, and software means for detecting movement of 
one or more monitored object and modifying the object 
representation of each object movement to indicate an 
updated position in the database; 

a plurahty of camera detectors for detecting one or more 
objects monitored by the controller, and generating a 
digitized image signal of the monitored object disposed 
relative to the camera, the controller receiving the 
digitized image signal to monitor such object; and 

a digital Internet network for selectively interconnecting 
the controller to one or more camera detectors; 

wherein the controller monitors a global position signal 
associated with a mobile position of a given object, the 
global position signal being generated by a cellular 
telephone associated with such given object when such 
object is moveable within an observable range, and a 
visual signal associated with a visible observation of 
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such given object, the visual signal being generated by 
a fixed camera detector uncoupled to such given object 
in the observable range, thereby enabling corroborative 
surveillance effectively by the controller of the given 
object by monitoring the positional and visual signals 
in the observable range, whereby a user monitoring the 
controller may communicate with the cellular tele- 
phone during the corroborative surveillance, the con- 
troller further monitoring a medical signal associated 
with physical sensing of the object, thereby enabling 
remote diagnosis of the medical signal corroboratively 
with the visual and positional signals. 

9. The system of claim 8 further comprising: 

at least one moveable UDit corresponding to at least one 
monitored object, each moveable unit comprising a 
Global Positioning Satellite (GPS) receiver for deter- 
mining a position of such moveable unit, each move- 
able unit coupled to the digital Internet network, such 
that the determined position is accessible by the con- 
troller. 

10. In a network comprising a controller coupled to a 
plurality of detectors, a method for electronically monitoring 
remote objects, the method comprising the steps of: 

monitoring remotely over an Internet connection by a 

controller one or more moveable objects detected by 

one or more detectors; 
maintaining a database comprising a representation of 

each monitored object; 
detecting a movement of one or more monitored object; 

and 

modifying in the database the object representation of 
each object movement to indicate an updated position; 

wherein the controller monitors a global position signal 
associated with a mobile position of a given object, the 
global position signal being generated by a cellular 
telephone associated with such given object when such 
object is moveable within an observable range, and a 
visual signal associated with a fixed visible observation 
of such given object in the observable range, thereby 
enabling corroborative surveillance effectively by the 
controller of the given object by monitoring the mobile 
positional and fixed visual signals in the observable 
range, whereby a user monitoring the controller may 
communicate with the cellular telephone during the 
corroborative surveillance, the controller further moni- 
toring a medical signal associated with physical sensing 
of the object, thereby enabling remote diagnosis of the 
medical signal corroboratively with the visual and 
positional signals. 

11. The method of claim 10 further comprising the steps 

of: 

determining by a moveable unit corresponding to at least 
one monitored object, the moveable unit comprising a 
Global Positioning Satellite (GPS) receiver accessible 
to the controller, a position of such moveable unit; and 

communicating the moveable unit position to the control- 
ler. 

12. In an integrated digital monitoring system comprising 
a fixed network including a controller and a plurality of 
detectors, and a mobile network including a plurality of 
mobile sensors associated with a plurality of mobile objects, 
such sensors and detectors coupled to the Internet, a method 
for object surveiQancc comprising the steps of: 

receiving from at least one detector of the fixed network 
a first signal for monitoring an object associated there- 
with; 
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receiving from at least one sensor of the mobile network 
a second signal for monitoring the associated object; 

determining a location of the associated object according 
to the first signal or the second signal; and 

storing in a database the location of the associated object. 

13. The method of claim 12 further comprising the steps 

of: 

selecting a local product source relatively proximate to 
JO the object location; and 

sending an indication of the selected product source 
through at least part of the mobile network for consid- 
eration by the object. 

14. The method of claim 12 further comprising the steps 

15 of: 

receiving from at least one detector of the fixed network 
a third signal for monitoring the object associated 
therewith; 

receiving from at least one sensor of the mobile network 
a fourth signal for monitoring the associated object; 

determining a changed location of the associated object 
according to the third signal or the fourth signal; and 

storing in the database the changed location of the asso- 
25 ciated object. 

15. The method of claim 12 further comprising the steps 

of: 

providing a map including the object location; and dis- 
playing the map and the object location included 
30 therein. 

16. Jn a console processing unit coupled via the Internet 
to at least one fixed detector and at least one mobile sensor, 
a data structure for representing a monitored object, the data 
structure comprising: 

an object identifier; 

a first object location and a time monitored at such 

location, provided by a detector coupled to the console 

processing unit; and 
a second object location and a time monitored at such 

location, provided by a sensor coupled to the console 

processing unit. 

17. The data structure of claim 16 further comprising: 

a scheduled object location and a time scheduled for such 
45 location. 

18. In an Internet-coupled network for electronically 
linking at least one fixed vendor processor to at least one 
mobile buyer processor, a method for transacting between 
vendor and buyer processors, the method comprising the 

50 steps of: 

determining a first location of a mobile buyer processor 
coupled to the Internet; 

receiving from the mobile buyer processor a first trans- 
action message; and 

sending to the mobile buyer processor a second transac- 
tion message indicating a first fixed vendor processor 
proximately disposed to the first location. 

19. The method of claim 18 further comprising the steps 

of: 

determining a second location of the mobile buyer pro- 
cessor, 

receiving from the mobile buyer processor a third trans- 
action message; and 
65 sending to the mobile buyer processor a fourth transaction 
message indicating a second fixed vendor processor 
proximately disposed to the second location. 
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20. Integrated tele-medicine system using fixed and 
mobile processor communication for enabling remote medi- 
cal care, the system comprising: 

a care-giver processor coupled to a packet-switched digi- 
tal network, the care-giver processor accessing a data- 5 
base including a representation of an identity and a 
location of at least one remote patient; 

a mobile communications unit physically associated with 
a remote patient for monitoring at least one medical 
vital sign of such remote patient, the mobile commu- 
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nications unit communicating such monitored vital sign 
to the care-giver processor through the digital network; 
and 

a first detector coupled to the digital network and selected 
by the care-giver processor for observing the remote 
patient when such remote patient is determined by the 
care-giver processor to be located within a first obser- 
vation range of the selected first detector, 

♦ ♦ * ♦ » 
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